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Cochran's  Theorem,  Rank  Additivity 


and  Tripotent  Matrices 


T.  W.  Anderson  and  George  P.  H.  Styan 

Stanford  University  and  McGill  University  !: 

i  ■ 


1.  Introduction 


Let  x  be  a  pxl  random  vector  distributed  according  to  a  multivariate 

normal  distribution  with  mean  vector  0  and  covariance  matrix  I  .  We  will 

-P 

denote  this  by  x  -  N(0,  I).  Let  q  ,  ...,q,  be  quadratic  forms  in  x  with 

"  P  -LK 

ranks  r  ,...,r^,  respectively,  and  suppose  that  =  x'x.  Then  what 

has  become  well  known  as  Cochran's  Theorem  is  Theorem  II  of  Cochran 

(1931*,  p.  179):  A  necessary  and  sufficient  condition  that  q]t...,q^ 

2  r 

be  independently  distributed  as  x  is  that  2,r^  =  p. 

Rao  (1973,  §3b.M  gives  this  result  with  x  -  N(p,  I)  as  the  Fisher- 

Cochran  Theorem.  Fisher  (19P5)  showed  that  if  the  quadratic  form  q  in  x 

2  2 
is  distributed  as  then  x'x  -  q  is  distributed  as  Xp  ^  independently 

of  q,  cf.  James  (195P). 

>  Our  purpose  in  this  paper  is  to  review  various  extensions  of 
Cochran's  Theorem  in  a  bibliographic  and  historical  perspective,  with 
special  emphasis  on  matri x-* heoretie  analogues.  While  we  present  over 
30  references,  we  note  that  Gcarowsky  (1973)  has  a  rather  complete 
discussion  and  bibliography  on  the  distribution  of  quadratic  forms  in 


I 


normal  random  variables.  See  also  the  bibliography  by  Anderson,  Das 

r 

l 

Gupta,  and  Styan  (1972),  where  90  research  papers  published  through  1966 
are  listed  under  subject-matter  code  2.5  (distribution  of  quadratic  and 
bilinear  forms  in  normal  variables). 

The  first  section  is  devoted  to  a  survey  of  results  summarized  in 
Theorems  1.1  and  1.2.  The  proofs  are  given  in  Section  2.  In  the 
following  section  the  extensions  from  idempotent  to  tripotent  matrices 
are  given  and  proved. 

To  formulate  our  first  matrix- theoretic  extension  of  Cochran's 
Theorem  we  let  A  , . . . ,A^  be  pxp  symmetric  matrices  and  write  A  =  pL. 
Consider  the  following  statements: 


(a)  =  /L, 


i— 1 , . . .  ,k^ 


(b)  A^  =  0 


for  all  i^J  , 


(c)  A  -  I, 


(d)  £  rank(A^)  =  rank(A). 


Then  the  matrix-theoretic  analogue  of  Cochran's  Theorem  is: 


(a) ,  (b) ,  (c)  -►  (d) , 


(1.1) 


(c),  (d)  -*•  (a),  (b). 


(1.2) 


The  reason  that  these  two  versions  of  Cochran's  Theorem  are  equivalent 
follows  from  the  following  two  well-known  results : 


.  -  r  \  'j 


2 

We  write  trA  for  the  trace  of  A  and  note  that  when  A  =  A  then 
trA  =  rank(A);  this  result  holds  even  when  A  is  not  symmetric  (cf.,  e.g., 
Rao  (1973),  p.  28). 

2 

When  Z  =  I  the  condition  in  Lemma  1.1  reduces  to  A  =  A,  and  this 

was  first  given  by  Craig  (19^3)  with  p  =  0  and  then  by  Carpenter  (1950) 

with  p  possibly  nonzero.  (Thus  (a)  is  equivalent  to  q.  =  x'A.x  having 
2 

a  x  distribution  with  number  of  degrees  of  freedom  equal  to  rank(Ai).) 

Sakamoto  (191*1*,  Th.  II,  p.  5)  gave  the  more  general  version,  with  £ 

positive  definite  and  p  =  0.  Cochran  (193^,  Corollary  1,  p.  179)  took 

x  -  N(0,  I)  and  gave  Lemma  1.1  with  the  condition  that  all  the  nonzero 

2 

eigenvalues  of  A  be  equal  to  1  instead  of  the  condition  A  =  A. 


LEMMA  1.2.  Let  x  and  A  be  defined  as  in  Lemma  1.1  and  let  B  be 
nonrandom  and  symmetric.  Then  x'Ax  and  x'Bx  are  independently  distributed 
if  and  only  if  AZB  =  0. 

When  Z  =  I  the  condition  in  Lemma  1.2  reduces  to  AB  =  0,  and  this 
was  first  given  by  Craig  (19^3)  with  p  =  0  and  then  by  Carpenter  (1950) 


(1.3) 


|I  -  isA| • | I  -  itB|  =  |I  -  isA  -  itB| 

for  all  real  s  and  t,  where  i  =  /^T  and  |*|  denotes  determinant. 

Ogasawara  and  Takahashi  (1951.  Lenma  l)  gave  a  short  proof  that  (1.3) 
implies  AB  =  0  when  the  symmetric  matrice  A  and  B  are  not  necessarily 
positive  semi -definite. 

Cochran's  Theorem  was  first  extended  to  x  -  N(p,  I  )  by  Madow  (1940) 

and  then  to  x  .  N(0,  £),  £  positive  definite,  by  Ogawa  (1946,  1947),  who 

2 

also  relaxed  the  condition  (c)  to  A  =  A.  Ogasawara  and  Takahashi  (1951) 
extended  Cochran's  Theorem  to  x  -  N(y,  £),  £  positive  definite,  and  to 
x  ~  N(0,  £),  with  £  possibly  singular.  Extensions  to  x  -  N(y,  £),  with 
£  possibly  singular,  have  been  given  by  Styan  (1970,  Theorem  6)  and  Tan 
(1977.  Theorem  4.2);  Ogasawara  and  Takahashi  (1951)  extended  Lemmas  1.1 
and  1.2  to  x  -  N(p,  £),  with  £  possibly  singular. 

James  (1952)  appears  to  be  the  first  to  notice  that  (l.l)  could 
be  extended  to 


(a) ,  (c)  -*  (b),  (d), 

(b) ,  (c)  -+  (a),  (d), 

while 

(a),  (b)  -+  A2  =  A  and  (d) 

2 

follows  at  once  from  the  definition  of  the  x  -distribution. 

Chipman  find  Rao  (1964)  and  Khatri  (1968)  extended  the  matrix 
analogue  of  Cochran's  Theorem  to  square  matrices  which  are  not  necessarily 


4 


4 


symmetric: 


THEOREM  1.1.  Let  A^ , . . . ,A^  be  square  matrices,  not  necessaril; 
symmetric ,  and  let  A  =  £a^.  Consider  the  following  statements: 


A?  =  A. , 
-1  -1 


i—1 » • • • 


6i^  -  ? 


for  all  i/j. 


A2  =  A, 


(d)  JVankCAj  =  rank(A) , 


(e)  rankCA^)  =  rankCA^}, 


i=l, . . . ,k. 


(a),  (b)  ->■  (c),  (d),  (e). 


(l.M 


(a),  (c)  -»  (b),  (d),  (e). 


(1.5) 


(b),  (c),  (e)  -*■  (a),  (d). 


(1.6) 


(c),  (d)  -*  (a),  (b),  (e), 


(l.T) 


As  Rao  and  Mitra  (1971»  p.  112)  point  out,  the  extra  condition  (e)  in 
(1.6)  is  required  (to  cover  possible  asymmetry);  for  if  k=2  and 


0  1 


0  -1 


0  0 


0  0 


then  (b),  (c)  hold,  but  (a)  and  (d)  do  not.  Banerjee  and  Nagase  (1976) 
replace  the  extra  condition  (e)  in  (1.6)  by 


(f)  rank(A^)  =  trAi , 


i=l, . . . ,k. 


and  prove  that 
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(b),  (c),  (f)  (a),  (d);  (1.8) 

however,  the  condition  (b)  is  now  no  longer  required  on  the  left  of 
(1.8)  since 

(c),  (f)  -  (a),  (b),  (d) 

follows  from 

rank(A)  =  trA  =  tr^A^  =  £trA^  =  ^rank(A^) 

and  (1.7). 

In  Section  2  we  present  several  proofs  of  Theorem  1.1. 

Marsaglia  and  Styan  (197M  extended  Theorem  1.1  by  considering  an 
arbitrary  sum  of  matrices,  which  may  now  be  rectangular .  The  analogue  of 
Theorem  1.1  is 


THEOREM  1.2.  Let  A^» • . . ,A^  be  pxq  matrices ,  and  let  A  =  £a^ . 
Consider  the  following  statements: 


(a1) 

A.A"A.  =  A. , 

-1-  -1  ~x 

i=l  •  •  •  *R  * 

(b ' ) 

a.a~a.  =  0 

-I*  -j 

for  all  i^J , 

(c')  rank(AiA  A^)  =  ranktAj, 

(d')  ^ranJs(Ai)  =  rank(A) , 

where  A  is  some  g-inverse  of  A.  Then 

i=l, . . . ,k. 

(a1) 

-  (b* ) ,  (C),  (d1 ) , 

(1-9) 

(b* ) ,  (c* ) 

-  (a1),  (d’). 

(1.10) 

(d') 

->  (a1),  (V),  (C). 

6 

(1.11) 

If  (a')  or  if  (b' )  and  (c')  hold  for  some  g-inverse  A~  then  (a*),  (b' ) 
and  (o' )  hold  for  every  g-inverse  A-. 

In  Theorem  1.2  we  define  a  g-inverse  of  A  as  any  solution  A  to 
AA  A  =  A,  cf.  Rao  (1962),  Rao  and  Mitra  (1971). 

The  condition  (o')  in  Theorem  1.2  plays  the  role  of  condition  (e) 
in  Theorem  1.1. 

Marsaglia  and  Styan  (197*+,  Th.  13)  proved  (1.11),  while  Hartwig 
(1980)  has  established  (1.9).  The  proposition  (1.10),  however,  appears 
to  be  new  and  is  proved  in  Section  2,  where  we  also  present  several 
different  proofs  of  (1.7).  In  Section  3  we  extend  Theorem  1.1  to 
tripotent  matrices,  following  the  work  by  Luther  (1965),  Tan  (1975,  1976) 
and  Khatri  (1977).  In  Section  h  we  discuss  the  applications  of  these 
algebraic  theorems  to  statistics. 


2.  Some  Proofs 

2.1.  Proof  of  Theorem  1.1.  To  prove  (l.7)  in  Theorem  1.1  we  begin 
by  reducing  condition  (c)  to  a  sum  being  I  as  in  the  earlier  version  of 
Cochran's  Theorem;  then  (1.7)  reduces  to  (1.2).  We  may  do  this  since 
if  A  is  p*p,  not  necessarily  symmetric,  then,  as  we  shall  show, 

A2  =  A  rank(l  -  A)  =  p  -  rank(A).  (2.1) 

(Note  Fisher's  1925  result  goes  both  ways,  cf.  Section  1,  paragraph  2.) 
To  prove  (2.1)  let  A2  =  A;  then  (l-A)2=I-A  and  so 

rank(I  -  A)  =  tr(I  -  A)  =  p  -  trA  =  p  -  rank(A). 
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i 


To  go  the  other  way  we  follow  Krafft  (1978,  pp.  1+07-1*08)  by  noting  that 


ft(A)  c  C(I  -  A), 


(2.2) 


where  fi(A)  =  {x  :  Ax  =  0}  is  the  null  space  of  A  and  C(l  -  A)  =  {(I  -A)x} 
is  the  column  space  of  I-A.  (If  xfft(A),  then  Ax  =  0  and  (I  -  A)x  = 
XfC(I-A).)  If  rank(l-A)  =  p  -  rank(A) ,  then  equality  must  hold  in 

p 

(2.2)  and  so  A  =  A. 

We  now  write  AQ  =  I  -A,  and  in  view  of  (2.1)  we  replace  (c)  by 

^•i=0~i  =  l*  and  by  £i=o  rank^i^  =  P- 

The  proof  of  (1.7)  by  Cochran  (1931+,  p.  180),  cf.  also  Anderson 

(1958*  p.  l6U)  and  Rao  (1973,  §3b.l+),  requires  that  A^ , . . . ,A^  be  symmetric. 

In  this  event  we  may  write 


aa  -  PjP:  - 


i=0,l , . . . ,k ,  (2.3) 


where  is  pxp^ ,  is  pxq^,  and  Ai  has  pi  positive  and  q  .  negative 

eigenvalues,  cf.  e.g.,  Anderson  (1958,  p.  3U6).  In  (2.3)  we  assume 

that  P.  has  rank  p. ,  Q  has  rank  q. ,  and  p.  +  q.  =  r. ,  the  rank  of  A. . 

-1  1  -i  1  1  1  1 

Hence 

ip =  1  ■  X  -  X  «i«i 


i=0  A  i=0 


(P0..  •  •  »p^ .Qq * -  *  >0^) 


i  0 

-p-q 


0  -1 


(2.1*) 


=  PJP', 


say,  where  q  =  qi,  since  from  (d)  now  p  =  I^_0  ri  =  [^(p-^q^ 

rK 

(ii:.g  P^)  +  I*  But  (2.1*)  is  positive  definite  and  P  is  nonsingular; 


:r  *  *  ;  • . 
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A.  A .  +  A, A.  =  0. 
~i~J  'J'l 


9 


Premultiplying  by  yields 


A. A.  +  A. A  A.  =  0, 


: 2.6 ) 


while  postmultiplying  (2.6)  by  A^  yields 


2A.A.A.  =  0  =  A. A .A. . 

-  -i-j~i 


Substituting  into  (2.6)  yields  (b). 

Our  next  proof  of  (1.7)  follows  Chipman  and  Rao  (196^,  p.  I ) ,  cf. 
also  Styan  (1970,  p.  571 ).  We  write 


A.  =  B.C! , 

~i  -i~i 


where  B.  and  C.  are  pxr.  of  rank  r. .  Then 

~i  ~i  l  l 


I  =  Ta.  =  VB.C! 

-p  ‘■-l  ‘'-l-i 


’?k^ 


BC’ , 


Si 


say.  By  (d)  B  and  C  are  both  nonsingular  and  so  C1  =  B  1  and 


C'B  =  I  = 

-  -  -p 


9o?o 


?k?0 


So?k 


c'b. 

~k~k 


which  implies  that 


at  =  b.c.’b.c:  =  b,c:  =  A.  , 

-1  'l'i'i'i  'i'i  -l 


A. A,  =  B.C!B,C'  =  0 
-l-j  -l-i-j-j 


Hence  (1.7)  is  established. 


for  all  i^j . 
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Our  last  proof  of  (1.7)  follows  Loynes  (1966),  cf.  also  Searle 
(1971.  p.  63).  A  rank-subadditivity  argument  is  used  similar  to  that 
used  in  (2.5): 

p  -  rank(Ak)  <  rank(lp-Ay) 

<  rank(A0,A1,...,Ak_1,Ip-Ak) 

=  rank(A0,...,Ak_1,I-A0  -  ...  -  A^-^) 

=  rank(AQ, . . . .A^^) 

<  rank(AQ)  +  ...  +  rank(A^  ^) 

=  p  -  rank(Ak). 

The  rest  of  Theorem  1.1  is  easily  proved.  To  prove  (l.l*)  we  see 
that  (a),  (b)  -*■ 

A2  =  (lA.)2  =lA2  +  l  A.Aj  =lA.  =  A, 

i '  ) 

while 

\  rank(A^)  =  ]  k^  =  tr  ][  k^  -  tr  A  =  rank(A) ,  (2.7) 

and  so  (1.1*)  is  established. 

To  prove  (1.5)  we  see  that  (a),  (c)  -*■  (d)  from  (2.7)  and  so  (1.5) 
follows  from  (1.7)- 

To  prove  (1.6)  we  see  that  (b) ,  (c) 


multiplying  through  by  A^  yields 
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(2.H) 


using  (b).  To  see  that  (2.8)  -+  (a)  we  use  the  rank  cancellation  rule 
(2.13)  in  Marsaglia  and  Styan  (1971*,  p.  271);  this  rule  will  also  be 
useful  later  on. 

LEMMA  2.1.  Right-hand  Rank  Cancellation  Rule.  If 

LAX  =  MAX  and  rank ( AX )  =  rank (A)  (2.9) 

for  some  conformable  matrices  A,  L,  M  and  X,  then 

LA  =  MA.  (2.10) 

Thus  (2.8)  -*■  (a)  by  replacing  L,  A  and  X  in  (2.9)  by  A.  and  M  by  I.  Then 

-  'l 

(2.9)  becomes  (2.8)  and  (e),  while  (2.10)  becomes  (a).  (We  note  that 
the  two  matrices  A^  and  A^  displayed  right  after  Theorem  1.1  satisfy  (2.8) 
but  not  (e).)  Then  (d)  follows  from  (1.1*)  or  (1.5). 

Proof  of  Lemma  2.1.  Let  A  =  BC ' ,  where  B  and  C  have  r  columns  and 

r  =  rank(A)  =  rank(B)  =  rank(C).  Then  rank(AX)  =  rank(BC'X)  =  rank(C'X)  = 

rank(A),  and  so  C'X  has  full  row  rank.  Thus  LAX  =  MAX  equals 

LBC'X  =  MBC'X  -*■  LB  =  MB  ->■  LBC '  =  MBC'  ,  which  is  (2.10).  Q.E.D. 

Transposing  the  matrices  in  Lemma  2.1  yields: 

LEMMA  2.2.  Left-hand  Rank  Cancellation  Rule.  Ijf 

LAX  =  LAY  and  rank(LA)  =  rank(A) 

for  some  conformable  matrices  A,  L,  X  and  Y,  then 

AX  =  AY. 
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2.2.  Proof  of  Theorem  1.2.  Premultiplying  (a1)  by  A-  yields  (a)  of 
Theorem  1.1  with  replaced  by  A-A^.  Moreover,  condition  (c)  of 
Theorem  1.1  now  always  holds  since  A-A  = £ A-A^  is  always  idempotent. 

Hence  (1.5)  implies  that  A_A.A-A  =  0  for  all  i#j .  Premultiplying  by  A. 
and  using  (a’)  yields  (b1).  Furthermore  (1.5)  implies  that 

£  rank(A-Ai)  =  rank  £a  A^  =  rank(A), 

which  reduces  to  (d1)  since  (a1) 

rank(A  A^ )  =  ranktA^),  (2.1l) 

which  follows  from 

rank(A^)  =  rank(A^A  A^ )  <  rank(A  A^)  <  rank(A^). 

Thus  (1.9)  is  established. 

We  now  prove  (l.ll).  Condition  (d’)  implies 

£  rank(Ai)  =  rank(A)  =  rank(A_A)  =  rank(^A-Ai)  <^rank(A-Ai) 

<£rank(A^)  (2.12) 

and  so  (d)  of  Theorem  1.1  holds  with  A.^  replaced  by  A-^.  Since  (c)  now 
always  holds  we  obtain  in  lieu  of  (a) 

A"A,A-A.  =  A"A.  (2.13) 

-  -i-  ~i  .  -i 

by  (1.7).  But  (2.12)  implies  (2.11)  and  so  we  may  cancel  the  front  A 
on  both  sides  of  (2.12)  using  Lemma  2.2  to  yield  (a’).  The  rest  of 
(l.ll)  follows  from  (1.9). 
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To  prove  (1.10)  we  use  the  same  technique  which  we  used  above 


to  yield 


a~a.a~a.a~a.  *  a~a.a~a. , 

~  ,  -1-  -j.’ 


(2.1k) 


which  is  (2.8)  with  A^  replaced  by  A  A^.  The  rank  condition  (c1)  and 
Lemma  2.1  allow  us  to  cancel  the  A  A^  on  the  right  of  both  sides  of  (2.1k) 
to  yield 


A  A.A  A.  =  A  A..  (2.15) 

Using  (2.1l)  and  Lemma  2.2  allows  us  to  cancel  the  leading  A-  on  both 
sides  of  (2.15)  and  this  yields  (a').  The  rest  of  (1.10)  follows  from 
(1.9)  and  the  proof  is  complete.  Q.E.D. 


We  may  extend  Theorem  1.1  to  tripotent  matrices  using  Theorem  1.2. 
We  do  this  in  the  next  section. 


Tripotent  Matrices 


A  square  matrix  A  is  said  to  be  tripotent  whenever  A''  =  A.  Tripotent 

matrices  have  been  studied  by  Luther  (1965),  Tan  (1975,  1976)  and 

Khatri  (1977).  These  authors  considered  extending  Theorem  1.1  to 

^l’.’*’^k  ^r^P°^ent*  This  is  of  interest  in  statistics  since  if  x  -  g.(0,  I) 

and  A  is  symmetric  nonrandom  then  x'Ax  is  distributed  as  the  difference 

2  3 

of  two  independently  distributed  \  -variates  if  and  only  if  A  =  A,  cf. 
Graybill  (1969,  p.  352),  Tan  (1975,  Theorem  3.5). 


Consider,  therefore,  the  following  statements: 

(a")  A3  =  A^ ,  i=l , . .  .  ,k , 

(b")  AjA^  =  0  for  1#J» 

(c")  A3  =  A, 

(d")  £rank(A J  =  rank(A). 


Then  it  is  easy  to  see  that  (a"),  (b")  -*•  (e").  To  see  that  (d")  is  also 
implied  we  note  that  when  A3  =  A  then,  cf.  Graybill  (1969,  Theorem  12.U.M, 
Hao  and  Mitra  (1971,  Lemma  5.6.1), 


rank(A)  =  trA2,  (3.1) 

2  2o 

since  A  is  now  idempotent,  and  has  rank  equal  to  trA  =  rank(A*“)  > 

rank(A3)  =  rank(A)  >  rank(A2).  Thus 

l  rankU^  =  £trA^  =  tr$A2  =  trA2  =  rank(A) 


when  (a"),  (b"),  (c")  hold.  Notice  that  we  have  not  supposed  that 
^l’‘*’,J^k  8X6  sylnme6rici  the  equality  (3.1)  holds  even  when  A  is  not 
symmetric . 

As  Khatri  (1977,  p.  88)  has  pointed  out,  (c”)  and  (d”)  need  not 
imply  (a")  and  (b")  even  if  the  A^ ' s  are  symmetric;  e.g.,  if 


*1 


2 

14 


o' 

-1 


then  rank(A1)  +  rank(A2)  =1  +  1  =  2  =  rank(A)  and  A3  =  A,  but  A3  4  A^ 
A 2  ?  A2>  A^A2  f  0.  It  is,  therefore,  of  interest  to  see  what  extra 
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condition  could  be  added  to  (c")  and  (d")  so  as  to  imply  (a")  and  (b"). 
Khatri  (1977,  Lemma  10 )  uses 

rank(A)  =  ranklA^A2  +  A)  ]  +  rankf/L  (A^  -  A)  ] } ,  (3.2) 

which  is  rather  complicated.  We  may  simplify  (3.2)  in  various  ways.  To 
do  this  we  first  note  that 

A3  =  A  A  =  A-,  (3.3) 

cf.  Graybill  (1969,  Theorem  12.U.1),  Rao  and  Mitra  (1971,  Lemma  5.6.2). 

Thus  Theorem  1.2  implies  that  (e"),  (d")  are  equivalent  to 

A,AA.  =  A.  ,  i=l . k,  (  3.M 

-  a  •  -  i  -  i 

and 

A  AA  =  0  for  all  i#J .  (3.5) 

*i"  J 

Summing  (3.h)  over  all  ,)j*i  and  adding  to  (3.1*)  yields 

A. A'  =  A. ,  i=l , . . .  ,k.  (3.6) 

-  1  -  ”1 

Hence  under  (c")  and  (d")  the  condition  (3.2)  is  equivalent  to 

rank(A)  = £  { rank( A^( I  ♦ A)  1  ♦  rank ( A . ( I  -  A)  ) ) ,  (3.7) 

which  is  a  little  simpler  than  (3.2).  But  (3.7)  implies 

rank(A)  >  ^rank^A^)  *£  ra.nX ( A^  )  (  3.8) 

=  rank(A) 

when  (d")  holds.  Thus  equality  holds  throughout  (3.8)  and  so  1  3.7)  implies 

ranMA^)  *  rank ( A^ ( I  + A ) 1  ♦  rank[A  ( I  -  A)  ) ,  i*l,...,k.  (3.9) 

Summing  (3.9)  and  using  (d")  yields  (3.7). 
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Some  motivation  for  the  condition  (3.9),  and  hence  also  for  the 
equivalent  conditions  (3.2)  and  (3-7),  may  be  obtained  from  the  following 
characterization  of  a  tripotent  matrix,  extending  Lemma  5.6.6  in  Rao  and 
Mitra  (1971,  p.  llU): 

LEMMA  3.1.  Let  A  be  a  square  matrix,  not  necessarily  symmetric. 

Then  A3  =  A  if  and  only  if 

rank(A)  =  rank(A  +  A2)  +  rank(A-A“).  (3.10) 

2  2 

Proof.  We  use  Theorem  1.2  with  A^  =  A  +  A  ,  A^=A-A  ,  and 
A.  +  A  =  2A.  If  A3  =  A  then  ^A  =  (2A)~  and  (3.10)  follows  from  (1.9) 

~  1  ~  d  -  ~  -  d- 

since 

(A  +  A2)  |A(A  +  A2)  =  |a3  AU  +  |a5 
=  A  +  A2, 

and  similarly 

(A -A2)  ^A(A-A2)  =  A  -  A2. 

To  go  the  other  way  we  use  (l.ll).  Then  (3.10)  implies 
0  =  (A  +  A2)  (A-  A2)  =  |a  -  Ja3 

3 

and  so  A  =  A  and  the  proof  is  complete.  Q.E.D. 

This  suggests  using  the  condition 

k  k  =  A2,  i=l,. . .  ,k,  ( 3.11) 

instead  of  (3.9),  or  (3.7)  or  (3.2).  We  obtain: 
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Proof.  We  have  already  shown  that  (a"),  (b")  imply  (c"),  (d")  and 

hence  also  (e"),  (3.9),  (3.7),  (3.2),  (el)  and  (e2).  To  go  the  other  way 

let  (c"),  (d")  hold.  Then  (3.1*)  and  (3-5)  are  true.  Substituting  (e") 

2 

yields  (a")  and  A^Aj  =  0  for  all  i/J;  premultiplying  by  yields  (b"). 

We  have  shown  that  when  (c”),  (d")  hold,  then  (3.9),  (3.7)  and  (3.2)  are 
equivalent.  To  see  that  (a"),  (b")  are  implied  we  use  Theorem  1.2  with 
the  A^'s  replaced  by  the  A^(I+A)  and  the  A^I-A)  in  (3.7),  which 
equation  shows  them  to  be  rank-additive  (the  sum  is  2A).  Then  (1. 11) 
implies  that 
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>«  - '  •  •♦v. 


(3.12) 


A.  (I  +A)(|A)A  (I  -  A)  =  0, 
using  ^A  =  (2A)  .  Substituting  (3.^)  and  (3.6)  into  (3.12)  yields 
(A.  +  A?) ( I  -  A)  =  0. 

Postraultiplying  by  A^  (j^i)  and  using  (3.5)  gives 

<3-13) 

However,  (l.ll)  also  implies,  cf.  (3.12), 

A.(I  -  A)(|A)A.(I  +A)  =  0, 
which  leads  to 

Adding  (3.13)  and  (3.lL)  yields  (b"),  and  substituting  (b")  into  (3.M 
gives  (a"). 

Now  let  (c"),  (d"),  (el)  hold.  Then  (3.1*),  (3.5)  hold  and  preraulti- 
plying  (3.5)  by  A.  yields  (b").  Then  (3.1*)  implies  (a").  Finally,  we  let 
(c")  (d")  (e2)  hold.  Then  substitution  of  (e2)  into  (3.1*)  yields  (el), 
and  the  proof  is  complete.  Q.E.D. 

Khatri  (1977,  Lemma  10)  proved  the  part  of  Theorem  3.1  with  (e") 
replaced  by  (1.2).  He  also  claimed  that  (b"),  (c")  -*•  (a"),  (d"),  (e"). 

But  this  is  not  so  for  the  same  reason  that  this  does  not  hold  in 
Theorem  1.1;  again  if  we  let 


f° 

1 

fo 

-1 

,  = 

0 

-2 

0 

1° 

0 
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then  (b"),  (c")  hold,  but  (a"),  (d")  do  not.  If,  however,  we  add  the 
condition 

(e'")  rank(A?)  =  rank(A^) 

to  (b"),  (c")  as  was  done  in  Theorem  1.1,  then  (a"),  (d")  do  follow. 
From  (b"),  (c")  we  have 

hi  -  lh 

and  so,  cf.  (2.8) 


2 

which  implies  A^  =  A^  using  (e'")  and  Lemma  2.1. 

The  commutativity  condition  in  Theorem  3.1: 

(e2)  AJV  =  AA^ ,  i=l,...,k, 

has  been  used  before  in  a  generalization  of  Cochran's  Theorem.  Recall 
the  statements . 

(b")  A. A,  =  0  for  all  i^j , 

-  1  ^  J  — 

(d")  £  rank(A^)  =  rank(A), 

(e'")  rank(A?)  =  rank^),  i=l,...,k. 

Then  Marsaglia  (1967,  Theorem  3)  and  Marsaglia  and  Styan  ( 197** ,  Theorem  15 ) 
proved  that 

(b"),  (d")  ~  (d"),  (e2) 

(b”),  (e’”)  -►  (d"),  13.16) 


its- '  ■  .*V 
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while  Luther  (1965*  Theorem  1,  p.  68U)  and  Taussky  (1966,  Theorem  2) 


f 


assuming  the  A^'s  to  be  symmetric,  proved  that 


(b")  (d"),  (e2). 


The  condition  (e"')in  (3.16)  cannot  be  dropped  in  view  of  the  example 
(3.15);  when  the  A^s  are  symmetric,  however,  (e”')  is  automatically 
satisfied. 

Luther  (1965,  Theorem  3,  p.  689)  and  Tan  (1976,  Theorem  2.2)  have 
given  versions  of  Theorem  3*1  when  the  A. 's  are  symmetric.  We  obtain: 


~i 


THEOREM  3.2.  Let  A^ , . . . , A^  be  symmetric  matrices  and  let  A  =  I A j ■ 


Then 


and 


(a”) 


(b") 


hold  if  and  only  if 
(c") 


A.  =  A. , 
-I  -a 


A. A,  =  0 


A3  =  A, 


(d")  \  rank(A.)  =  rank(A), 

i=l 


and 


(es) 


trAA^  >  trA“T, 


The  condition  (es)  may  be  replaced  by 


(esl) 


trA  >  T  trAf 
~  i=l 


or  by 


(es2)  rank(Ai)  >  trA.^ , 
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i=l , . . . ,k , 


for  all  i^j 


i=l, . . . ,k-l . 


i=l,. . . ,k-l. 


-  * ;  •  *  .r  v. 


The  condition  (es2)  was  used  by  Luther  (1965,  Theorem  3,  p.  689), 
who  also  showed  that  the  condition  (es)  may  be  replaced  by 

trAjAj  >  0  for  all  i#j ;  (3.17) 

summing  (3.17)  over  all  i^j  yields  (esl).  Luther  also  considered  the 
condition 

A?  =  A. ,  i=l,. . . ,k-l,  (3.18) 

and  proved  that  (3*18),  (c"),  (d")  (a"),  (b"),  while  Khatri  (1977,  Lemma  10 

and  Note  9)  showed  that  (a"),  (c"),  (d")  ->■  (bn).  But  (a")  clearly  implies 
(3.18),  which  implies  (es2)  with  equality  in  view  of  (3.1).  Tan  (1976, 
Theorem  2.2)  gives  a  condition  which  seems  to  be  intended  to  be  (esl) 
with  equality  (Tan  has  an  extra  $  (in  his  notation)  inside  the  trace  on 
both  sides  of  his  condition). 

Our  proof  of  Theorem  3.2  uses  the  following  result,  cf.  Graybill 
(1969,  p.  235)- 

LEMMA  3-2.  Let  A  be  a  square  matrix.  Then 
trA'A  >  trA2 

with  equality  if  and  only  if  A  is  symmetric. 

Proof.  The  result  follows  at  once  from 

tr(A  -  A' ) ' (A  -  A' )  =  2(trA'A  -  trA2)  >  0.  Q.E.D. 

Proof  of  Theorem  3.2.  That  (a"),  (b")  imply  (c"),  (d"),  (es),  (esl), 
(es2)  follows  from  Theorem  3.1.  To  go  the  other  way,  let  (c"),  (d")  hold. 
Then  (3-M  and  (3.6)  hold,  and  so 
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(3.19) 


trA.A2A.  =  tr(AA.)'AA.  >  tr(AA.)2  =  trAA.AA. 
i ~  ^ i  ~  ^ 

becomes 

trA?  >  trMi-  (3.20) 

The  condition  (es)  implies  equality  in  (3-20),  and  hence  in  (3.19)  and 
so  by  Lemma  3.2  AA^  =  (AA^)'  =  A^A,  which  is  condition  (e2)  of  Theorem  3.1, 
but  only  for  i=l,...,k-l.  Substitution  in  (3.6)  yields 

AAJi.  =  0,  i=l , . .  .  ,k-l  and  j^i .  (3.2l) 

But  (3.^)  implies  that  rank(AA^)  =  rank(A^ )  and  so  by  Lemma  2.2  we  may 
cancel  the  A  in  (3-21)  to  get 


A^Aj  =  0,  i=l,...,k-l  and  j^i. 

Thus 

Mk  =  9  »  Mi*  i=i,...,k-i, 

upon  transposition  and  so  (b")  holds.  Substitution  in  i3.b)  yields  (a"). 

Now  suppose  (c"),  (d"),  (esl)  hold.  Then  so  does  (3.20)  which  we 
may  sum  to  yield 

k  ?  ? 

Y  trA  >  trA  . 

L.  1  ““ 

i=l 

But  (esl)  indicates  that  this  inequality  goes  the  other  way  and  so  we 
must  have  equality,  which  in  turn  implies  equality  in  (3.19)  and  that  AA^ 
is  symmetric  for  all  i=l,...,k.  Thus  (a"),  (b")  are  implied  as  before. 

Finally  let  (c"),  (d"),  (es?)  hold.  Then  from  (3.*+)  AA^  is 
idempotent  and  so 

2 

trAA^  =  rank(AA^)  =  rank(A^)  z  trA^,  i=l,...,k-l, 

is  condition  (es)  and  our  proof  is  complete. 

2  3 


Q.E.D. 


We  conclude  this  section  with  an  extension  of  Theorem  3.1  to  r-potent 
matrices.  We  define  a  square  matrix  A  to  be  r-potent  whenever  A  =  A 
for  some  positive  integer  r  >  2.  As  Tan  (197?,  Lemma  l)  has  pointed  out, 
the  nonzero  eigenvalues  of  an  r-potent  matrix  are  the  (r-l)th  roots  of 
unity.  Since  a  symmetric  matrix  has  only  real  eigenvalues,  a  symmetric 
r-potent  matrix  must  be  tripotent  even  though  Tan  (1976,  p.  608)  suggests 
otherwise . 

We  obtain: 

THEOREM  3.3.  Let  A^ , .  . . ,A^  be  square  matrices,  not  necessarily 
symmetric,  and  let  A  =  £a^.  Let  r  be  a  fixed  positive  integer  >  2.  Then 

(a)  ~i  =  -i’  i=l , . . .  ,k 

and 

(b)  A. A.  =  0  for  all  i # j 

**  i  ~  J 

hold  if  and  only  if 

(c)  Ar  =  A, 

(d)  rank(/L)  =  rank(A), 

and 

(e) r  A. A  =  Ai  ,  i=l, • • •  ,k. 

The  condition  (e)r  may  be  replaced  by 

(el)  A^Ar"2  =  A  ,  i=l,...,k, 

r  ' l -  -I 

or  by 

(e2)  A. Ar_2  =  Ar  2A. ,  i=l,...,k. 

r  - 1 '  '  •  ] 


2h 


Tan  (1975,  Theorem  2.1)  suggested  that  (c),  (d)  (a),  (b)  but, 

cf.  Khatri  (1976),  seems  to  have  realized  that  this  is  not  true  (Tan,  1976). 

When  r  =  3  the  conditions  (e)f,  (el)^,  (e2)y  become  the  conditions  (e), 

(el),  (e2),  respectively,  of  Theorem  3.1.  When  r=2  the  conditions  (e)  , 

r 

(e2)^  are  automatically  satisfied  and  Theorem  3.3  becomes  part  of 

Theorem  1.1.  The  condition  (el)  ,  however,  when  r  =  2  becomes  A.  =  A.  , 

r  ~i  -i 

or  (a),  and  so  (el)^  may  be  too  strong  an  extra  condition  to  require  that 
(c),  (d)  -*  (a),  (b)  in  Theorem  3.3.  Under  (c),  (d),  however,  the 
condition  (el)^  is  equivalent  to  the  commutativity  condition 

A.(A.Ar-2)  =  (A.Ar_2)A.,  i=l,...,k,  (3.22) 

which  is  in  the  same  spirit  as  the  condition  (e2)^.  When  r  =  2  the 
condition  (3.22)  is  automatically  satisfied. 

To  prove  that  the  conditions  (3.22)  and  (el)r  are  equivalent  when 
(c),  (d)  hold  we  note  first  that  A  =  A  when  A  is  r-potent .  Then, 

cf.  ( 3-1*)  —  (3-6) ,  we  see  that  (c),  (d)  are  equivalent  to 

A.Ar"2A.  =  A.,  i=l,...,k,  (3.23) 

A.Ar-2A.  =  0  for  all  i£j,  (3-2U) 

X  -  J 

A.A1'-1  =  A.,  i=l , .  .  .  ,k ,  (3.25) 

and  (3.23)  shows  that  (  3. 22 )<-*-( el )  . 

r 

Proof  of  Theorem  3.3.  Let  (a),  (b)  hold.  Then  so  does  (c),  and 

,  r-1,2  r+r-2  Ar-1 

(A.  )  =  A.  =  A. 

-l  'l  -l 

is  idempotent  and  so 
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rank(A^)  =  trA^  ^ , 

cf.  (3-1).  Hence  (a),  (b),  (c)  imply 

£  rank(A^  =  £  trA^  =tr  £a.  =  trA  =  rank(A), 

which  is  (d).  Then  (b)  implies  (e)^  and  (e2)^  and  turns  (el)r  into  (a). 

To  go  the  other  way,  let  (c),  (d),  (e)^  hold.  Then  so  do  (3-23),  (3.2l). 
Substitution  of  (e)  into  (3.23)  yields  (a),  whiie  substitution  of  (e) 

I*— 1 

into  (3.2l)  yields  A.  A.  =  0  =  A. A.  upon  premultiplication  by  A.  and 
~i  ~j  '  'i'J  'i 

substituting  (a). 

Now  let  (c),  (d),  (el)^  hold.  Then  (3.23),  (3-2U)  hold  and 

postmulti plying  (el)  by  A.  (,1^i)  yields  (b)  by  substituting  (3-2l).  Then 

^  <3 

(a)  follows  from  (3.23)  by  use  of  (b) .  Finally,  suppose  that  (c),  (d), 

(e2)  hold.  Premultiplying  (e2)  by  A.  and  substituting  (3*23)  yields 
r  r 

(el)  and  so  our  proof  is  complete.  Q.E.D. 

r 

Tan  (I97cdi  Theorem  2.1)  also  suggested  that  (b),  (c)  and 

rank(A^  "L)  =  rank(A^r  ^ )  ,  i  =  L,...,k,  (3.26) 

imply  (a),  (d),  but  withdrew  this,  cf.  Tan  (idi’b,  p.  608).  It  is 
straightforward,  however,  to  see  that  (b) ,  (c)  imply 

lAr  =  A. 

L'i  'i 

and  hence 

Ar+1  =  A2.  (3.27) 

-l  -I 

The  extra  condition 

rank(Al)  =  rank(Ai), 
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cf.  (e"')  ,  applied  to  (3.27)  then  yields  (a)  in  view  of  the  rank, 
cancellation  rule  Lemma  2.1.  The  extra  condition  (3.?6)  is,  however, 
not  sufficient  (unless  r  =  2),  as  is  seen  from  the  counter-example 
provided  by  (3.15). 


L .  Statistical  Applications 

The  analysis  of  variance  involves  the  .decomposition  of  a  sum  of 

squares  of  observations  into  quadratic  forms.  In  classical  cases  these 

2 

quadratic  forms  are  independently  distributed  according  to  x  -distributions. 

Then  ratios  of  them  are  proportional  to  F-statistics .  Cochran's  Theorem 

provides  an  algebraic  method  of  verifying  the  necessary  properties  of  the 

quadratic  forms  to  justify  the  F-tests. 

As  indicated  in  Lemma  1.1,  when  x  has  the  distribution  N(0,  I)  then 
2  2 

A  =  A  implies  x'Ax  has  the  x  -distribution  with  degrees  of  freedom  equal 
to  the  number  of  unit  eigenvalues  of  A,  the  other  eigenvalues  being  0. 

Lemma  1.2  states  that  AB  =  0  implies  independence  of  x'Ax  and  x'Bx 
because  the  joint  characteristic  function  when  x  -  H(0,  I)  is,  cf.  (1.3), 


C  +  =  ll-isA-itBl’^- 


=  jl  -  i 3A| -isp| l  _  itB  ’°5P| 


-%P| 


As  an  example,  consider  the  one-way  analysis  of  variance.  Let  y 


ia 


be  normally  distributed  according  to  N(p. ,  a  ),  i=l,...,m,  a  =  l,...,n, 
and  suppose  the  mn  variables  are  independent.  Under  the  typical  null 
hypothesis  H:  p^  =  ...  =  p^  =  p,  say,  the  exponent  of  the  normal 


r 


distribution  is  Y™  J1}  (y.  -u).^  Let 

^-1=1  ^j=l  ia 


^1  =  n  I  (yi  -  y)"  =  n  Y  yY  -  nrny  , 
i=l  i=l 


ra  n  0  m  a  r,  ni 

.1.  lMa-*ir  ‘  \  I  ’ 

i-I  a=l  i=l  a=i  1=1 


_o 

mn  y“~ , 


where  y.  =  yia/N  and  y  =  Ij=1  y^tn-  Let  y( 


(yir. 


(m) '  .  , 


A,  =  ~( I  -  e')  ®  e  e', 

~1  n  -m  nr  m-m  ~n~n 


A  =  I  «  ( I  -  K  e  ’ ) , 
-2  ~m  ~n  n-n-n 


At  *  —  e  e '  ®  e  e ' , 
'3  mn  ~m~m  ~n~n 


* ’^in  '  ’ 


where  e^  =  (l,. of  n  components  and  em  =  (l,...,l)'  of  m  components. 

Then  q.  =  y'A.y.  We  easily  verify  that  LA.  =  I  ,  ranklA  )  =  m-1, 

' i  mn  - 1 

ranklA^)  =  m(n-l),  and  rank(A^)  =  1.  Then  (a)  and  (b)  hold.  (Of  course, 

in  the  simple  example  above  the  conditions  could  be  verified  directly.)  By 

Lemmas  1.1  and  1.2  the  quadratic  forms  are  independently  distributed  as 
2 

X  's,  the  last  being  noncentral. 

2 

The  multivariate  analogue  of  the  x  -distribution  is  the  Wishart 

distribution.  If  Y  ,  ...,Y  are  independently  distributed,  each  according 

N 

to  N(0,  E),  then  the  distribution  of  S  =  Y  ,  Y  Y'  is  known  as  the  Wishart 
=  -  ~  6a=l  -a~a 

distribution.  (Cf.  e.g..  Chapter  ^  of  Anderson  (1958).)  If  q^,...,q^ 

2 

have  independent  \  -distributions  when  the  dimensionality  of  is  1, 


then  Si  =  Ia,0=i  aij}  Ue’---’Sk  =  ,8=1  ^  W  haVe  indePendent 

Wishart  distributions;  here  A.  =  (a^),  i=l,...,k.  Cochran's  Theorem 

~  1  Ctp 

is  correspondingly  useful  in  multivariate  analysis  of  variance. 

It  should  be  noted  that  when  are  symmetric  several  proofs 

show  that  there  exists  an  orthogonal  matrix  that  simultaneously 

diagonalizes  A  ,...,A^,  the  resulting  diagonal  matrices  have  0's  and  l's 

as  diagonal  elements,  and  the  l's  in  the  transformed  A^  correspond  to  0's 

in  the  transformed  A  ,  Jj^i.  Cf.  (2*3 )-(2.h). 

”  J 

If  A^  =  A,  the  eigenvalues  of  A  are  1,  -1,  and  0.  Hence  x'Ax  for 

2  2  2  2 

x~fl(0,  I)  has  the  distribution  of  x^  -  X2>  where  x-^  and  x2  are  independent,  the 

2 

number  of  degrees  of  freedom  of  x^  is  the  number  of  eigenvalues  equal  to  1 

2 

and  the  number  of  degrees  of  freedom  of  x2  is  the  number  of  eigenvalues  equal  to  -1. 

Components  of  variance  are  often  estimated  as  differences  of 

quadratic  forms.  Let  y^^  =  p  +  +  v  ,  i*l,...,m»  where  P 

is  an  unobservable  constant  and  the  unobservable  u.'s  and  v.  's  are 

l  ia 

2  2 

independently  normally  distributed  with  means  0  and  variances  £u^  =  ou 

2  2 

andCv.  =  o  .  Then  for  q.,  and  q0  as  defined  above 
ia  v  1  2 

=  (m-l)(nau  +  o^) , 


Cq2  =  (mn-m)ov . 


2 

Thus  q^  (m-l)  -  q^^mn-m)  is  an  unbiased  estimator  of  no^.  Other 

differences  of  quadratic  forms  arise  in  other  designs. 

Press  (1966)  has  given  the  distribution  of  an  arbitrary  quadratic 

2 

form,  which  is  a  linear  combination  of  x  ' s  with  possibly  negative 

2  2  2  2 

coefficients.  Let  Z  =  ax-^  -  8x2>  where  x^  and  X2  are  independently 
2 

distributed  as  x  -variables  with  m  and  n  degrees  of  freedom,  respectively. 
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and  a  >  0,  £  >  0.  The  density  of  Z  is 

[K/r('2m)  ]t  2^m  1  e  a^['2n,  '2(m+n);  f  ( a+H ) /fat!  ]  ,  t  >  0, 

[K/r(’*n)  ](-t)  L  e 1  /'  %  [  ’2m ,  m+n )  ;  -  t  (u+0  )  /  2a+0  ]  ,  t  <  0, 

i  „-l  *4  (m+n)  jin  -2n 

where  K  =2  ap  and 


4<(a,b,x)  =  - 


_  r(i-b) 


r ( b— i )  l-b  n 


I'(  l+a-b)  1 


F1(a,b;x)  +  ^ j'-  x  "u  ^  (l+a-b, 2-b;x)  , 


and  ^F^(a,b;x)  is  the  confluent  hypergeomet ri e  function.  Robinson  (1965) 
gave  a  similar  result  for  u=0=l .  In  the  special  case  of  equal  degrees  of 
freedom  (n  =  m)  Pearson,  Stouffer  and  David  (1932)  gave  the  density  of 

v  2  2 

Z  =  Xx  ~  X2  as 


zP~h  K  ,  (2z) 

n~j- . 

2/n  f(n) 


where  K  (x)  is  the  Bessel  function  of  second  order  and  imaginary  argument, 
r 

In  Theorem  3.2  (a" ) indicates  that  q.  =  x’A.x  is  distributed  as  the 
2 

difference  of  twc  x  -variables  if  x  ~  N(0,  I)  and  (b") states  that  q.  and  q 

*  0 

are  independent.  Then  (c")and  (d")and  either  (es),  (esl),  or  (es2)  are 
conditions  implying  (a")and  (b"i  In  most  cases  (e")  is  easily  verified 

and  (d")is  as  in  Section  1.  Each  of  (es),  (esl),  and  (es2)  require 

2  2 
computation  of  trAp  i=l,...,k-l,  and  (esl)  needs  also  trA^ .  Of  the 

2 

left-hand  sides,  trA  may  be  easiest  to  compute. 
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